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We address the problem of portfolio optimization under the simplest coherent risk measure, i.e. 
the expected shortfall. As it is well known, one can map this problem into a linear programming 
setting. For some values of the external parameters, when the available time series is too short, 
I the portfolio optimization is ill posed because it leads to unbounded positions, infinitely short on 

, some assets and infinitely long on some others. As first observed by Kondor and coworkers, this 

' phenomenon is actually a phase transition. We investigate the nature of this transition by means 

^SJ ' of a replica approach. 

I. INTRODUCTION 

Among the several risk measures existing in the context of portfolio optimization, expected shortfall (ES) has 
certainly gained increasing popularity in recent years. In several practical applications, ES is starting to replace the 
classical Value-at-Risk (VaR). There are a number of reasons for this. For a given threshold probability /?, the VaR 
I ■ is defined so that with probability /3 the loss will be smaller than VaR. This definition only gives the minimum loss 



^ _ one can reasonaoiy expect but does not tell anytnmg about tnc typical value ot tnat loss tnat can be measured by 
^ . the conditional value-at-risk (CVaR, which is the same as ES for continuous distributions that wc consider here jl3l | 



^ ).Wc will be more precise on these definitions below. The point wc want to stress here is that the VaR measure, 

^ , lacking the mandatory properties of subadditivity and convexity, is not coherent [l| . This means that summing VaR's 

' ^ ' of individual portfolios will not necessarily produce an upper bound for the VaR of the combined portfolio, thus 
contradicting the holy principle of diversification in finance. A nice practical example of the inconsistency of VaR in 

f~i ■ credit portfolio management is reported in Ref. On the other hand, it has been shown 0] that ES is a coherent 

Cin] measure with interesting properties Moreover, the optimization of ES can be reduced to linear programming 

(which allows for a fast implementation) and leads to a good estimate for the VaR as a byproduct of the minimization 

' process. To summarize, the intuitive and simple character, together with the mathematical properties (coherence) 

^ , and the fast algorithmic implementation (linear programming), are the main reasons behind the growing importance 

lO ' of ES as a risk measure. 

, In this paper, we will focus on the feasibility of the portfolio optimization problem under the ES measure of risk. 

■ The control parameters of this problem are [i) the imposed threshold in probability, /3, and (m) the ratio N /T between 
\ the number N of financial assets making up the portfolio and the time series length T used to sample the probability 

■ distribution of returns. (It is curious that, albeit trivial, the scaling in N/T had not been explicitly pointed out 

I before |^.) It has been discovered in Q that, for certain values of these parameters, the optimization problem does 

i , not have a finite solution because, even if convex, it is not bounded from below. Extended numerical simulations 
^ . ... 

^ allowed these authors to determine the feasibility map of the problem. Here, in order to better understand the root 
■ ^ , of the problem and to study the transition from a feasible regime to an unfeasible one (corresponding to an ill-posed 
^Lj' minimization problem) we address the same problem from an analytical point of view. 

t~| The paper is organized as follows. In Section^lwe briefly recall the basic definitions of /3-VaR and /3-CVaR and we 

show how the portfolio optimization problem can be reduced to linear programming. Wc introduce a "cost function" 
^ ' to be minimized under linear constraints and wc discuss the rationale for a statistical mechanics approach. In Section 
mil wc solve the problem of optimizing large portfolios under ES using the replica approach. Our results and the 
comparison with numerics arc reported in Section llVI and our conclusions arc summarized in Section Ivl 
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II. THE OPTIMIZATION PROBLEM 



We consider a portfolio of A'' financial instruments w = {wi, . . . wn}, where Wi is the position of asset i. The global 
budget constraint fixes the sum of these numbers: we impose for example 

N 

J2w.=N. (1) 

i=l 

We do not stipulate any constraint on short selling, so that Wi can be any negative or positive number. This is, of 
course, irrealistic for liquidity reasons, but considering this case allows us to show up the essence of the phenomenon. 
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FIG. 1: Schematic representation of the VaR measure of risk. 'P<(w) is the probabihty of a loss associated to the portfoho w 
being smaUer than a. The conditional VaR /3-CVaR (or ES) is the average loss when this is constrained to be greater than the 
/3-VaR. 



If we imposed a constraint that would render the domain of the Wi bounded (such as a ban on short selling), this 
would evidently prevent the weights from diverging, but a vestige of the transition would still remain in the form of 
large, though finite, fluctuations of the weights, and in a large number of them sticking to the "walls" of the domain. 

We denote the returns on the assets by x = {xi, X2, ■ ■ ■ xn} , and we will assume an underlying normal distribution 
p(x) ~ Y\-exp{—Nx'^/2). The corresponding loss is ^(w|x) — —J2iLi''^i^i' ^^'^ the probability of that loss being 
smaller than a given threshold a is 

V<{w,a)^ J dxp{x)9{a-e{w\x)) , (2) 

where 9{-) is the Hcavisidc step function, equal to 1 if its argument is positive and otherwise. The /3-VaR of this 
portfolio is formally defined by 

/3-VaR(w) = min{a : V<{w, a) > (3} , (3) 

(see Fig.^, while the CVaR (or ES, in this case) associated with the same portfolio is the average loss on the tail of 
the distribution, 



. dx p(x)^(w|x)6'(£(w|x) - /3-VaR(w)) 

/3-CVaR(w) = ^ = — — / dx p(x)^(w|x)6'(^(w|x) - /3-VaR(w)) . (4) 

' dx p(x)6i(^(w|x) - /3-VaR(w)) ^^P J 



The threshold /3 then represents a confidence level. In practice, the typical values of (3 which one considers are 
(3 = 0.90,0.95, and 0.99, but we will address the problem for any (3 G [0,1]. What is usually called "exceedance 
probability" in some previous literature would correspond here to (1 — /3). 

As mentioned in the introduction, the ES measure can be obtained from a variational principle @ . The minimization 
of a properly chosen objective function leads directly to Q): 

/3-CVaR(w) = minF^(w,w), (5) 

V 

F^(w, v) = v + {l- (3)-^ J dx p(x) [^(w|x) -v]^ . (6) 

Here, Ja]"*" = (a + |a|)/2. The external parameter v over which one has to minimize is claimed to be relevant in 
itself [31, since its optimal value may represent a good estimate for the actual value-at-risk of the portfolio. We will 
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come back to this point as we discuss our results. Wc stress here that minimizing © over w and v is equivalent to 
optimizing Q over the portfolio vectors w. 

Of course, in practical cases the probability distribution of the loss is not known and must be inferred from the 
past data. In other words, we need an "in-sample" estimate of the integral in which would turn a well posed 
(but useless) optimization problem into a practical approach. We thus approximate the integral by sampling the 
probability distributions of returns. For a given time series x^^\ . . .x^-^^ our objective function becomes simply 



T T 



N 



(7) 



where we denote by Xir the return of asset i at time r. Optimizing this risk measure is the same as the following 
linear programming problem: 



• given one data sample, i.e. a matrix Xir, i — 1, . . . N ^ t — 1, 

• minimize the cost Junction 



■ T, 



• over the (A^ + T + 1) variables Y = {wi 

• under the {2T + 1) constraints 



Ej3 [v, {Wi}, {Ur}; {Xir}] = (1 - f3)Tv + y^Mr 
WN,Ui, . ..utv}, 



(8) 



N 



N 



Ur>0 



It + V + XirWi > Vt , and 'i 



N 



(9) 



Since we allow short positions, not all the Wi are positive, which makes this problem different from standard linear 
programming. To keep the problem tractable, we impose the condition that Wi > —W, where is a very large 
cutoff, and the optimization problem will be said to be ill-defined if its solution does not converge to a finite limit 
when W oo. It is now clear why constraining all the Wi to be non- negative would eliminate the feasibility problem: 
a finite solution will always exists because the weights are by definition bounded, the worst case being an optimal 
portfolio with only one non-zero weight taking care of the total budget. The control parameters that govern the 
problem are the threshold /3 and the ratio N/T of assets to data points. The resulting "phase diagram" is then a line 
in the (3-N /T plane separating a region in which, with high probability, the minimization problem is not bounded and 
thus does not admit a finite solution, and another region in which a finite solution exists. These statements arc non- 
deterministic because of the intrinsic probabilistic nature of the returns. We will address this minimization problem 
in the non-trivial limit where T oo, N oo, while N/T stays finite. In this "thermodynamic" limit, we shall 
assume that extensive quantities (like the average loss of the optimal portfolio, i.e. the minimum cost function) do 
not fluctuate, namely that their probability distribution is concentrated around the mean value. This "self-averaging" 
property has been proven for a wide range of similar statistical mechanics models 0- Then, we will be interested 
in the average value of the min of © over the distribution of returns. Given the similarity of portfolio optimization 
with the statistical physics of disordered systems, this problem can be addressed analytically by means of a replica 
approach 

III. THE REPLICA APPROACH 

We consider one given sample, i.e. a given history of returns Xir drawn from the distribution 

p{{x.r})^X{e-''^^^/^ . (10) 

ir 

In order to compute the minimal cost, we introduce the partition function at inverse temperature 7. Recalling that 
Y is the set of all variables, the partition function at inverse temperature 7 is defined as 



V 



Z^[{x^r}] = / dYexp ~jEf3[Y;{x^r}] (H) 
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where V is the convex polytope defined by (j^jl. The intensive minimal cost corresponding to this sample is then 
computed as 



N- 



iiimE[{xir}] .. ,. -1 
= Imi hm —— 



eK-^ir}] = Jim """""^r'"'^''^ = Jim lini_ log Z-f[{xir}] 



N 



(12) 



Actually, we are interested in the average value of this quantity over the choice of the sample. Equation H12() tells us 
that the average minimum cost depends on the average of the logarithm of Z. This difficulty is usually circumvented 
by means of the so called "replica trick" : one computes the average of Z". where n is an integer, and then the average 
of the logarithm is obtained by 



log Z = lim 



dn 



(13) 



thus assuming that Z" can be analytically continued to real values of n. The overline stands for an average over 
different samples, i.e. over the probability distribution (|1U|1 . This technique has a long history in the physics of spin 
glasses 0: the proof that it leads to the correct solution has been obtained ^3 recently. 
The partition fimction Hll() can be written more explicitly as 



/-foo r+00 T /'+00 ^ /'+ioo 

'Oo ^0 r — 1 J — 00 J —ioQ 



N 



n-\-00 /' + 100 



N 



exp 



-7(1 - (3)Tv -l^Ur 



(14) 



where the constraints are imposed by means of the Lagrange multipliers A, /i, /t. In view of applying the trick in H13|l . 
we introduce n identical replicas of the system corresponding to the same history of returns {a;,;,-}, and write down 
Z"[{a;ii-}]- After this, the average over the samples can be performed and allows one to introduce the overlap matrix 



Q 



ah 



1 ^ 

— w1w\ , a, 6 = 1, . 



(15) 



as well as its conjugate Q°'^ (the Lagrange multiplier imposing p5|l '). Here, a and h are replica indexes. After (several) 
Gaussian integrals, one is left with 

/+00 ^ p+OQ /'+ioo I 

n dv'' / J] dg"^ / l[ dQ'^'' exp i TV ^ Q^'^g'^^ - TV ^ g"'' - 7(1 - /?)T ^ i;"^ 

a=l a.b a,b I a,b a.b a 



-Tn log 7 + T log Z, {{v^'}, {Q-'}) - ^Tr log g - ^Tr log g - ^ log 2 I , 



(16) 



where 



z,(K},W'})^ 



+00 ri 



n '^y" 



a=l 



a=l 



a,h=l 



(17) 



We now write T — tN and work at fixed t while N 00. 

The most natural solution is obtained by realizing that all the replicas are identical. Given the linear character of 
the problem, the symmetric solution should be the correct one. The replica-symmetric solution corresponds to the 

ansatz 



Q 



ab 



qi ii a = b 
qo if a 7^ & ' 



g 



ab 



qi if a = 
qo if a ^ 6 



(18) 



and v"" = V for any a. As we discuss in detail in appendix^ one can show that the optimal cost function, computed 
as from eq. (|12|l but with the average of the log, is the minimum of 



£iv,qo,A) = ^ + A 



+ 00 



dse ^ g{v + s^/2qo) 



(19) 
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FIG. 2: Left panel: The phase diagram of the feasibihty problem for expected shortfall. Right panel: The order parameter A 
diverges with an exponent 1/2 as the transition line is approached. A curve of slope —1/2 is also shown for comparison. 



where A = lim-y_>oo 7Ag and the function g(-) is defined as 

g{x) = Ix^ -1 < a; < , (20) 




Note that this function and its derivative are continuous. Moreover, v and go in Hlij|) are solutions of the saddle point 
equations 

1-/3+-^ / dse-'\\v^ syfl^^) = 0, (21) 



2V^ 

t f 2 

-1 + / dse^" s g'{v + sV2go) = . (22) 



We require that the minimum of l|19|) occur at a finite value of A. In order to understand this point, we recall the 
meaning of A (see also (|18|) '): 

N N 

1 / n'iN2 1 



A/7 ~ - (<zi - <Zo) = ^ E (^r')' - ]^ E -w^~w\ (23) 

i=l i=l 



where the superscripts (1) and (2) represent two generic replicas of the system. We then find that A is proportional 
to the fluctuations in the distribution of the w's. An infinite value of A would then correspond to a portfolio which is 
infinitely short on some particular positions and, because of the global budget constraint infinitely long on some 
other ones. 

Given H19|l . the existence of a solution at finite A translates into the following condition: 

t{l - (3)v - ^ + -_ / dse-'\{v + s V2g^) > , (24) 
which defines, along with eqs. (|21ll and H22|) . om- phase diagram. 



IV. THE PHASE DIAGRAM 



We can now chart the feasibility map of the expected shortfall problem. We will use as control parameters N/T = 1/t 
and f3. The limiting case (3—^1 can be worked out analytically and one can show that the critical value t* is given 

by 



1 



O 



(25) 
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This limit corresponds to the over-pessimistic case of maximal loss, in which the single worst loss contribute to the 
risk measure. The optimization problem is the following: 



max ( ~ X! 



re{l,...T} 



(26) 



A simple "geometric" argument by Kondor et al. borrowed from a random geometry context |l2l | leads to the 
critical value \/t* = 0.5 in this extreme case. The idea is the following. According to cq. H26|l . one has to look for 
the minimum of a polytope made by a large number of planes, whose normal vectors (the Xir) are drawn from a 
symmetric distribution. The simplex is convex, but with some probability it can be unbounded from below and the 
optimization problem is ill defined. Increasing T means that the probability of this event decreases, because there are 
more planes and thus it is more likely that for large values of the Wi the max over t has a positive slope in the i-th 
direction. The exact law for this probability can be obtained by induction on N and T and, as we said, it jumps 
in the thermodynamic limit from 1 to at N /T ~ 0.5. Given that the corrections to this limit case are exponentially 
small (eq. (I25|l 'l. the threshold 0.5 can be considered as a good approximation of the actual value for many cases of 
practical interest (i.e. (3 > 0.9). 

For finite values of /3 we have solved numerically eqs. (|21|l . 1)22(1 and (|24|l using the following procedure. We first 
solve the two equations (|21|l and H22|l . which always admit a solution for [v, qo). We then plot the l.h.s. of eq. (|24|) as 
a function of 1/t for a fixed value of /?. This function is positive at small 1/t and becomes negative beyond a threshold 
1/t*. By keeping track of 1/t* (numerically obtaining via linear interpolations) for each value of (3 we build up the 
phase diagram (Fig. |21 left) . We show in the right panel of Fig. |21 the divergence of the order parameter A versus 
1/t — 1/t* . The critical exponent is found to be 1/2: 



1 1 



t t*i/3) 



(27) 



, again in agreement with the scaling found in 0. We have performed extensive numerical simulations in order to 
check the validity of our analytical findings. For a given realization of the time series, we solve the optimization 
problem ((HJ by standard finear programming We impose a large negative cutoff for the w's, that is Wi > —W, 
and we say that a feasible solution exists if it stays finite for — > oo. We then repeat the procedure for a certain 
number of samples, and then average our final results (optimal cost, optimal v, and the variance of the w's in the 
optimal portfolio) over those of them which produced a finite solution. In Fig. 13 we show how the probability of 
finding a finite solution depends on the size of the problem. Here, the probability is simply defined in terms of the 
frequency. We see that the convergence towards the expected 1-0 law is fairly slow, and a finite size scaling analysis 
is shown in the right panel. Without loss of generality, we can summarize the finite- iV numerical results by writing 
the probability of finding a finite solution as 



p{N,T,f3)^f 



1 



t t*iP) 



(28) 



where f{x) ^ 1 if x ^ 1 and f{x) — > if a; ^ 1, and where a(l) = 1/2. 

In Fig. 21 (left panel) we plot, for a given value of /3, the optimal cost found numerically for several values of the size 
N compared to the analytical prediction at infinite N. One can show that the cost vanishes as ~ (1/^ ~ l/t*y^^. 
The right panel of the same figure shows the behavior of the value of v which leads to the optimal cost versus N/T, 
for the same fixed value of /3. Also in this case, the analytical {N oo limit) is plotted for comparison. We note that 
this quantity was suggested to be a good approximation of the VaR of the optimal portfolio: We find here that 
Vopt diverges at the critical threshold and becomes negative at an even smaller value of N/T. 



V. CONCLUSIONS 



We have shown that the problem of optimizing a portfolio under the expected shortfall measure of risk by using 
empirical distributions of returns is not well defined when the ratio N/T of assets to data points is larger than 
a certain critical value. This value depends on the threshold /3 of the risk measure in a continuous way and this 
defines a phase diagram. The lower the value of /3, the larger the length of the time series needed for the portfolio 
optimization. The analytical approach we have discussed in this paper allows us to have a clear understanding of this 
phase transition. The mathematical reason for the non- feasibility of the optimization problem is that, with a certain 
probability p{N ,T, 13), the linear constraints in (jS)) define a simplex which is not bounded from below, thus leading 
to a solution which is not finite (Aq ^ oo in our language), in the same way as it happens in the extreme case /3 — > 1 
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FIG. 3: Left: The probability of finding a finite solution as obtained from linear programming at increasing values of A'^ and 
with P = 0.8. Right: Scaling plot of the same data. The critical value is set equal to the analytical one, N /T = 0.4945 and the 
critical exponent is 1/2, i.e. the one obtained in [3 for the limit case /3 — » 1. The data do not collapse perfectly, and better 
results can be obtained by slightly changing either the critical value or the exponent. 



1 

0.8 

a 

■2 0.6 I- 

O 

I 0.4 
0.2 





TV = 32 




TV = 64 




N = 128 




N = 256 




analytic _ 












0.25 



0.3 



0.35 



TV 
T 



0.4 



0.45 



0.5 



0.4 
0.2 


-0.2 
-0.4 
-0.6 
-0.8 
-1 
-1.2 
-1.4 





















N = 32 






JV = 64 






"jV = 128 






"JV = 256 






analytic 







0.25 



0.3 



0.35 0.4 

JV 



0.45 



0.5 



FIG. 4: Numerical results from linear programming and comparison with analytical predictions at large A^. Left: The minimum 
cost of the optimization problem vs N/T, at increasing values of N . The thick line is the analytical solution 1191 . Here /3 = 0.7, 
(N/T)* ~ 0.463. Right: The optimal value of v as found numerically for several values of A'' is compared to the analytical 
solution. 



discussed in [3. From a more physical point of view, it is reasonable that the feasibihty of the problem depend on 
the number of data points we take from the time series with respect to the number of financial instruments of our 
portfolio. The probabilistic character of the time series is reflected in the probability p{N,T,P). Interestingly, this 
probability becomes a threshold function at large N if N/T = 1/t is finite, and its general form is given in (|28|l . 

These results have a practical relevance in portfolio optimization. The order parameter discussed in this paper 
is tightly related to the relative estimation error 0. The fact that this order parameter has been found to diverge 
means that in some regions of the parameter space the estimation error blows up, which makes the task of portfolio 
optimization completely meaningless. The divergence of estimation error is not limited to the case of expected shortfall. 
As shown in 0], it happens in the case of variance and absolute deviation as well 0|, but the noise sensitivity of 
expected shortfall turns out to be even greater than that of these more conventional risk measures. 

There is nothing surprising about the fact that if there are no sufficient data, the estimation error is large and we 
cannot make a good decision. What is surprising is that there is a sharply defined threshold where the estimation 
error actually diverges. 

For a given portfolio size, it is important to know that a minimum amount of data points is required in order to 
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perform an optimization based on empirical distributions. We also note that the divergence of the parameter A at 
the phase transition, which is directly related to the fluctuations of the optimal portfolio, may play a dramatic role 
in practical cases. To stress this point, we can define a sort of "susceptibility" with respect to the data, 

and one can show that this quantity diverges at the critical point, since Xij ^ A. A small change (or uncertainty) in 
becomes increasingly relevant as the transition is approached, and the portfolio optimization could then be very 
unstable even in the feasible region of the phase diagram. We stress that the susceptibility we have introduced might 
be considered as a measure of the effect of the noise on portfolio selection and is very reminiscent to the measure 
proposed in . 

In order to present a clean, analytic picture, we have made several simplifying assumptions in this work. We have 
omitted the constraint on the returns, liquidity constraints, correlations between the assets, nonstationary effects, etc. 
Some of these can be systematically taken into account and we plan to return to these finer details in a subsequent 
work. 
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APPENDIX A: THE REPLICA SYMMETRIC SOLUTION 



We show in this appendix how the minimum cost function corresponding to the replica-symmetric ansatz is obtained. 
The 'TrLogQ' term in H16(l is computed by realizing that the eigenvalues of such a symmetric matrix are {qi + {n~ 
1)90) (with multiplicity 1) and {qi — qo) with multiplicity n — 1. Then, 

TrlogQ = logdetg = log(gi + {n - l)qo) + {n - 1) log(gi - qo) ^ n (^logAq + ^) + 0{n^) , (Al) 

where Aq = qi — qo- The effective partition function in H17|l depends on Q^^, whose elements are: 

, ,_j{Aq-qo)/{Aq)^+Oin) if a ^ b 
^ -\-qol{Aqf+0{n) iia^h ^"""^ 

By introducing a Gaussian measure dPq^^s) = --^===e^'' /^lo ^ one can show that 

^logZ{v,q,,qo) = ilog|y'nda;ae-^2"(^")'+^2"(^°+'')''(^^°-'') 1 (s)e* ^° | 

= dPg,{s)logB^{s,v,Aq)+Oin) (A3) 

where we have defined 

B-y{s,v,Aq) = y da;exp ^--^^^^ + 7(2; + u)6'(-x - u)^ . (A4) 
The exponential in now reads expNn[S{qo, Aq, qo, Aq) + 0{n)], where 

S{qo, Aq, qo, Aq) = qoAq + qoAq + AqAq - Aq - jt{l - (3)v - tlogj + t j dPq„ (s) log B^{s, v, Aq) 



--logAg--(^logAg-f — ^ 



(A5) 



The saddle point equations for qo and Aq allow then to simplify this expression. The free energy {~j)f-y = 
lim„^o dZ^ I dn is given by 

-jf^{v,qo,Aq)^^-tlogj+^\ogAq+'^^^--ftil-P)v + t J dP,„ (s) log B^(s, t;, Ag) , (A6) 



9 



where the actual values of v,qo and Aq arc fixed by the saddle point equations 

= . (A7) 



dv dqo dAq 

A close inspection of these saddle point equations allows one to perform the low temperature 7 ^ 00 limit by assuming 
that Aq = A/7 while v and qQ do not depend on the temperature. In this limit one can show that 

{S + V + A/2 s < -V - A 

-(v + sf/2A -v-A<s<-v (A8) 
s>-v 

If we plug this expression into eq. (|A6p and perform the large-7 limit we get the minimum cost: 
We rescale x xA, v vA, and qo qoA^, and after some algebra we obtain eq. 119|l . 
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